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The Open Agent Architecture: 
A Framework for Building Distributed Software 

Systems 
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Menlo Park, CA 94025 USA 
+16508595552 
{martin,cheyer,moran}@ai.sri.com 

Abbreviated title: Open Agent Architecture 
Abstract: 

The Open Agent Architecture (OAA), developed and used for several years at SRI International, makes 
it possible for software services to be provided through the cooperative efforts of distributed collections 
of autonomous agents. Communication and cooperation between agents are brokered by one or more 
facilitators, which are responsible for matching requests, from users and agents, with descriptions of the 
capabilities of other agents. Thus, it is not generally required that a user or agent know the identities, 
locations, or number of other agents involved in satisfying a request. OAA is structured so as to 
minimize the effort involved in creating new agents and "wrapping" legacy applications, written in 
various languages and operating on various platforms; to encourage the reuse of existing agents; and to 
allow for dynamism and flexibility in the makeup of agent communities. Distinguishing features of OAA 
as compared with related work include extreme flexibility in using facilitator-based delegation of 
complex goals, triggers, and data management requests; agent-based provision of multimodal user 
interfaces; and built-in support for including the user as a privileged member of the agent community. 

This paper explains the structure and elements of agent-based systems constructed using OAA. The 
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BACKGROUND: 

An intelligent diagnosis system (IDS) for automated equipment is highly in demand because 
advantages: 

1. Availability: It is always available. 

2. Perpetual: It maintains knowledge permanently. 

3. Synthetic: It synthesizes knowledge from different experts. 

4. Effective and efficient: It provides more accurate diagnosis in less time. 

5. Flexible: Knowledge is constantly updated. 

6. Cost efficient: Once implemented, it only requires cost for maintenance. 

The success of any IDS depends on the quality of its knowledge, reasoning methodologies, a 
Knowledge acquisition becomes the bottleneck to developing such systems. 

OBJECTIVE: 
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The objective of this project is to develop a self-learning system to alleviate knowledge ; 
The project is based on genetic algorithm (GA) and design of experiment (DOE) methodolo^ 
failure data and extract rules from the data. Although a robot is selected for analysis, the syst 
expanded to acquire diagnosis knowledge for other equipment. 

APPROACH: 

The methodology employed for the system (a genetic algorithm) is based on the evolutic 
composed of population, operators (reproduce, crossover, and mutation), fitness function, an 
GA population consists of chromosome structures where each chromosome represents a solu 
problem. Reproduce operator selects the individuals that have a higher chance of survival. C 
part of the chromosome with a certain probability between different individual chromosome 
attributes within an individual chromosome. Fitness is the criteria determining whether an in 
environment or not. 

In this project, 13 exogenous variables form the symptoms according to the movement o 
movements in cartesian and joint modes and the HOME position). Each variable has two stal 
and "1" indicates errors observed in the movement. The cause can be any one of the 17 possi 
six encoders, and five micro switches). Each possible cause also has two statuses: "0" repres« 
condition and "1" indicates the part in faulty condition. 

With 17 possible causes of failures, the set of fault scenarios could reach up to 2 17 -1= 12 
Different combinations of faults could generate the same symptom. Hence, only a portion of 
Design of experiment (DOE) technique is used to determine the total number of data points i 
collected. Each data point is collected by simulating the robot's arm with some faults set aco 
experiment design. The collected data set is randomly divided into the training set (80%) anc 
each possible cause, this division is repeated five times. Each time the system will capture ru 
by applying a specific GA model. Then the integrity of the GA model is evaluated by testing 
and by utilizing the average fitness as a measure of the model integrity. The average of the n 
divisions yields the evaluation of this specific GA model as applied to the fault cause. GA ha 
paradigm and parameters could be set towards a specific problem. Therefore, different mode 
compared for selection of the best one. In this study, five paradigms are used, which are sum 
addition to these paradigms, three parameters are also concerned. They are Crossover Rate, ( 
many points in a chromosome can be crossovered), and Elitism (percentage of the populatioi 
"good solutions"). Crossover rate has four levels (0.6 - 0.9, with 0.1 step), crossover point h£ 
elitism has three levels (0.1, 0.14 and 0.18). The paradigms and parameters form 5*4*15*3 = 
All these 900 models are trained and tested for comparison. 

The evaluation results of 900 GA models are used to determine which paradigm or parai 
to the fitness. They are used as inputs to MINITAB for the analysis of variance (ANOVA) fc 
paradigm and parameters. The best model performs learning using the whole data set. The ru 
the knowledge. Validation ensures that the rules generated are true representations of the sys 
independent of the previous scenarios are collected. The extracted rules are tested against the 
high fitness is the indicator of the success of the knowledge acquisition system. 

RESULTS: 

The system is implemented using Borland C++, with a user-friendly interface. A typical lear 
illustrated in Figure 1. 
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Figure 1 . A learning procedure 

In Figure 1, the list box to the right presents all the individuals within a population, while the 
reveals that the average fitness of the population is going up along time axis. The results fror 
follows: 



• Diploid chromosome paradigms are better then single chromosome paradigm. Amonj 
paradigms, the Diploid-Non-Dominance-Non-Gender paradigm is the best one. 

• Small multiple crossover point (2-3) is superior. 

• Crossover rate and elitism factors are not significant in contributing to the fitness. 



Based on these results, the best GA model for the robot diagnosis analysis is: Diploid chromi 
Dominance-Non-Gender paradigm with crossover rate 0.6, elitism factor 0.14, crossover poi: 
generated from the analysis are listed in Table 2. 

CONCLUSIONS: 

This project applies genetic algorithm to extract knowledge from previous failure data. I 
knowledge acquisition procedure and alleviates the knowledge acquisition bottleneck. Previc 
adequately sampled using DOE technology. Different GA models are developed for selectioi 
best GA model extracts the final rules. The results from the system demonstrate the general i 
learning procedure; Diploid-Non-Dominance-Non-Gender GA paradigm with crossover rate 
and crossover point 2 is proved to be the most suitable model for robot diagnosis knowledge 

IMPACT: 

This research possesses high value for both education and industry. For education, this p 
algorithm, an efficient and effective machine learning method, to generate knowledge for ro 
algorithm has infrequently been applied in this domain. For industry, although the robot was 
application to illustrate the capabilities of the technique, the system is easily adapted for kno 
diagnosing other equipment. Only redefinition of symptoms and causes is required. The kno' 
also be implemented into the knowledge base for an intelligent diagnosis system. 

Table 1 . Summary of different paradigm s 

Jl II U || 
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Population 
Type 


Population 
Name 


Description 


Crossover Operator 


1 


Single 
chromosome 


An individual 
has only one 
chromosome 


Normal crossover is applied. The 
crossover points range between 1 
and Yz length of the chromosome. 


2 


Diploid-non 
dominance- 
non gender 


An individual 
has two 

chromosomes. 

Crossover can 
be of same or 
different 
gender. 


For single point crossover, the tw< 
parents exchange one 
chromosome with each other. 

For multiple point crossover, the 
two parents each provide one 
chromosome to form a new 
individual and then normal 
crossover is executed on the two 
chromosomes within this new 
individual. 


3 


Diploid- 
dominance- 
non gender 


An individual 
has two 

chromosomes. 

Crossover can 
be of same or 
different 
gender. 


For single point crossover, the tw( 
parents exchange one 
chromosome with each other. 

For multiple point crossover, the 
two parents each provide one 
chromosome to form a new 
individual and then normal 
crossover is executed on the two 
chromosomes within this new 
individual. 


4 


Diploid- non 
dominance- 
gender 


An individual 
has two 

chromosomes. 

Crossover can 
only be of 
different 
gender. 


First select a "male" and a 
"female" to be parents, then: 

For single point crossover, the tw< 
parents exchange one 
chromosome with each other. 

For multiple point crossover, the 
two parents each provide one 
chromosome to form a new 
individual and then normal 
crossover is executed on the two 
chromosomes within this new 
individual. 


5 


Diploid- 
dominance- 
gender 


An individual 
has two 

chromosomes. 

Crossover can 
be only of 
different 
gender. 


First select a "male" and a 
"female" to be parents, then: 

For single point crossover, the tw< 
parents exchange one 
chromosome with each other. 

For multiple point crossover, the 
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two parents each provide one 
chromosome to form a new 
individual and then normal 
crossover is executed on the two 
chromosomes within this new 
individual. 

'Fitness Function: f(g)= (Pg+N-Ng)/(P+N) where: 

• g: an individual (a learned rule). 

• P: the positive example number that the whole data has for a specified motor /encode 
(Positive example: when learning rules about a specific fault, all of the examples cor 
are treated as positive examples. Negative example: the rest of the examples in the d 

• N: the negative example number that the whole data has for a specified motor /encod 

• Pg: the positive example number that g covers within P. 

• Ng: the negative example number that g covers within N. 



Table 2. Sample rules learned for different faults 



Faults 


Rules Learned (String) 


Rules Learned (Standard 1 


Motor 1 


1122121202221 


IF X, Y and Roll movements in catasian rr 
movement in joint mode are faulty, but Ell 
joint mode is normal and Home fiinction i: 

THEN Motor 1 is malfunctioning. 


Motor 3 


1121222212122 


IF X, Y and Pitch movements in catasian r 
Roll movements in joint mode are faulty, 

THEN Motor 3 is malfunctioning. 


Encoder 4 


2222112221121 


IF Roll and Grip movement in catesian mc 
Pitch and Roll movement in joint mode are 
faulty, 

THEN Encoder 4 is malfunctioning. 


Microswitch 
3 


2122212212111 


IF Y and Grip movements in catesian mod 
Elbow, Roll and Grip movement in joint m 
HOME is faulty, 

THEN Micro switch 3 is malfunctioning. 
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BACKGROUND: 

An intelligent diagnosis system (IDS) for automated equipment is highly in demand because 
advantages: 

1. Availability: It is always available. 

2. Perpetual: It maintains knowledge permanently. 

3. Synthetic: It synthesizes knowledge from different experts. 

4. Effective and efficient: It provides more accurate diagnosis in less time. 

5. Flexible: Knowledge is constantly updated. 

6. Cost efficient: Once implemented, it only requires cost for maintenance. 

The success of any IDS depends on the quality of its knowledge, reasoning methodologies, a 
Knowledge acquisition becomes the bottleneck to developing such systems. 

OBJECTIVE: 

The objective of this project is to develop a self-learning system to alleviate knowledge ; 
The project is based on genetic algorithm (GA) and design of experiment (DOE) methodolo^ 
failure data and extract rules from the data. Although a robot is selected for analysis, the syst 
expanded to acquire diagnosis knowledge for other equipment. 

APPROACH: 



The methodology employed for the system (a genetic algorithm) is based on the evolutic 
composed of population, operators (reproduce, crossover, and mutation), fitness function, an 
GA population consists of chromosome structures where each chromosome represents a solu 
problem. Reproduce operator selects the individuals that have a higher chance of survival. C 
part of the chromosome with a certain probability between different individual chromosomes 
attributes within an individual chromosome. Fitness is the criteria determining whether an in 
environment or not. 

In this project, 13 exogenous variables form the symptoms according to the movement o 
movements in cartesian and joint modes and the HOME position). Each variable has two stal 
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and "1" indicates errors observed in the movement. The cause can be any one of the 17 possi 
six encoders, and five micro switches). Each possible cause also has two statuses: "0" represt 
condition and "1" indicates the part in faulty condition. 

With 17 possible causes of failures, the set of fault scenarios could reach up to 2 17 -1= 12 
Different combinations of faults could generate the same symptom. Hence, only a portion of 
Design of experiment (DOE) technique is used to determine the total number of data points s 
collected. Each data point is collected by simulating the robot's arm with some faults set aco 
experiment design. The collected data set is randomly divided into the training set (80%) and 
each possible cause, this division is repeated five times. Each time the system will capture ru 
by applying a specific GA model. Then the integrity of the GA model is evaluated by testing 
and by utilizing the average fitness as a measure of the model integrity. The average of the re 
divisions yields the evaluation of this specific GA model as applied to the fault cause. GA ha 
paradigm and parameters could be set towards a specific problem. Therefore, different mode 
compared for selection of the best one. In this study, five paradigms are used, which are sum 
addition to these paradigms, three parameters are also concerned. They are Crossover Rate, ( 
many points in a chromosome can be crossovered), and Elitism (percentage of the populatioi 
"good solutions"). Crossover rate has four levels (0.6 - 0.9, with 0.1 step), crossover point hi 
elitism has three levels (0.1, 0.14 and 0.18). The paradigms and parameters form 5*4*15*3 = 
All these 900 models are trained and tested for comparison. 

The evaluation results of 900 GA models are used to determine which paradigm or parai 
to the fitness. They are used as inputs to MINITAB for the analysis of variance (ANOVA) fc 
paradigm and parameters. The best model performs learning using the whole data set. The ru 
the knowledge. Validation ensures that the rules generated are true representations of the sys 
independent of the previous scenarios are collected. The extracted rules are tested against the 
high fitness is the indicator of the success of the knowledge acquisition system. 

RESULTS: 

The system is implemented using Borland C++, with a user- friendly interface. A typical lear 
illustrated in Figure 1. 
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Figure 1 . A learning procedure 

In Figure 1, the list box to the right presents all the individuals within a population, while the 
reveals that the average fitness of the population is going up along time axis. The results fror 
follows: 
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• Diploid chromosome paradigms are better then single chromosome paradigm. Anion; 
paradigms, the Diploid-Non-Dominance-Non-Gender paradigm is the best one. 

• Small multiple crossover point (2-3) is superior. 

• Crossover rate and elitism factors are not significant in contributing to the fitness. 

Based on these results, the best GA model for the robot diagnosis analysis is: Diploid chrom* 
Dominance-Non-Gender paradigm with crossover rate 0.6, elitism factor 0.14, crossover poi: 
generated from the analysis are listed in Table 2. 

CONCLUSIONS: 

This project applies genetic algorithm to extract knowledge from previous failure data. I 
knowledge acquisition procedure and alleviates the knowledge acquisition bottleneck. Previc 
adequately sampled using DOE technology. Different GA models are developed for selectioi 
best GA model extracts the final rules. The results from the system demonstrate the general i 
learning procedure; Diploid-Non-Dominance-Non-Gender GA paradigm with crossover rate 
and crossover point 2 is proved to be the most suitable model for robot diagnosis knowledge 

IMPACT: 

This research possesses high value for both education and industry. For education, this p 
algorithm, an efficient and effective machine learning method, to generate knowledge for rot 
algorithm has infrequently been applied in this domain. For industry, although the robot was 
application to illustrate the capabilities of the technique, the system is easily adapted for kno 
diagnosing other equipment. Only redefinition of symptoms and causes is required. The kno* 
also be implemented into the knowledge base for an intelligent diagnosis system. 



Table 1 . Summary of different paradigms 



Population 
Type 


Population 
Name 


Description 


Crossover Operator 


1 


Single 
chromosome 


An individual 
has only one 
chromosome 


Normal crossover is applied. The 
crossover points range between 1 
and 1 /2 length of the chromosome. 


2 


Diploid-non 
dominance- 
non gender 


An individual 
has two 
chromosomes. 
Crossover can 
be of same or 
different 
gender. 


For single point crossover, the two 
parents exchange one chromosom 
with each other. 

For multiple point crossover, the tw 
parents each provide one 
chromosome to form a new 
individual and then normal crossov 
is executed on the two 
chromosomes within this new 
individual. 


3 


Diploid- 
dominance- 
non gender 


An individual 
has two 
chromosomes. 
Crossover can 
be of same or 
different 
gender. 


For single point crossover, the two 
parents exchange one chromosom 
with each other. 

For multiple point crossover, the tw 
parents each provide one 
chromosome to form a new 
individual and then normal crossov 
is executed on the two 
chromosomes within this new 
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individual. 


4 


Diploid- non 
dominance- 
gender 


An individual 
has two 
chromosomes. 
Crossover can 
only be of 
different 
gender. 


First select a "male" and a "female* 
to be parents, then: 

For single point crossover, the two 
parents exchange one chromosom 
with each other. 

For multiple point crossover, the tw 
parents each provide one 
chromosome to form a new 
individual and then normal crossov 
is executed on the two 
chromosomes within this new 
individual. 


5 


Diploid- 
dominance- 
gender 


An individual 
has two 
chromosomes. 
Crossover can 
be only of 
different 
gender. 


First select a "male" and a "female 1 
to be parents, then: 

For single point crossover, the two 
parents exchange one chromosom 
with each other. 

For multiple point crossover, the tw 
parents each provide one 
chromosome to form a new 
individual and then normal crossov 
is executed on the two 
chromosomes within this new 
individual. 



Witness Function: f(g)= (Pg+N-Ng)/(P+N) where: 



• g: an individual (a learned rule). 

• P: the positive example number that the whole data has for a specified motor /encode 
(Positive example: when learning rules about a specific fault, all of the examples cor 
are treated as positive examples- Negative example: the rest of the examples in the d 

• N: the negative example number that the whole data has for a specified motor /encod 

• Pg: the positive example number that g covers within P. 

• Ng: the negative example number that g covers within N. 



Table 2. Sample rules learned for different faults 



Faults 


Rules Learned (String) 


Rules Learned (Standard I 


Motor 1 


1122121202221 


IF X, Y and Roll movements in catasian rr 
movement in joint mode are faulty, but Ell 
joint mode is normal and Home ftinction i: 

THEN Motor 1 is malfunctioning. 


Motor 3 


1121222212122 


IF X, Y and Pitch movements in catasian r 
Roll movements in joint mode are faulty, 
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THEN Motor 3 is malfunctioning. 




Encoder 4 


2222112221121 


IF Roll and Grip movement in catesian mc 
Pitch and Roll movement in joint mode are 
faulty, 

THEN Encoder 4 is malfunctioning. 




Microswitch 

•3 
J 


2122212212111 


IF Y and Grip movements in catesian mod 
Elbow, Roll and Grip movement in joint m 
HOME is faulty, 

THEN Micro switch 3 is malfunctioning. 
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ScienceDirect Journals 

Daily Breaking News on Emerging Technologies : 
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Friday, April 23, 2004 



These resources and services provide examiners with access to critical prior art. Most of the electronic 
resources listed on these Web pages are accessed via the Internet. You must be authenticated for 
data to be accessed. ► ^Sil^^M^ t tetlA ^l te 



■o* indicates tools featured in TC's NPL training. 



Information Resources 



Information Resources bv Class and Subclass 



Databases 

O ACM Digital Library 

Business Source Corporate 

(Multidisciplinary subject coverage) 
Dialog Classic on the Web 

(Training and password required.) 
DTIC STINET 

(Citations of Defense Technical Information Center scientific and technical documents) 
EEDD Submission Form 
Examiners' Electronic Digest Database (EEDD ) 

(Database of examiner submitted NPL) 
EPOQUE 

(EPO's databases, available on stand-alone terminal in CPK2, 4B40) 
lEEEXplore 

(Full page images of over 800,000 Electrical & Electronic Engineering articles, papers and 
standards, 1988 -present Select content is available from 1952-1987.) 
INSPEC 

(Seven million well-indexed physics, EE, and IT abstracts, 1969-present) 

IP.com 

(Defensive disclosures published to the Disclosures IP.com database from various websites) 
NTIS (National Technical Information Service) 

(resource for government-funded scientific, technical, engineering, and business related 

information) 
Proquest Direct 

(Multidisciplinary subject coverage) 
Readers' Guide to Periodical Literature 

(citations to popular multidisciplinary magazines) 
Research Disclosure 

(Published monthly as a paper journal and now as an online database product with advanced full 
text searching capabilities for defensive disclosure information.) 
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Software Patent Institute (SPI ) (Select Tree Access") 

(Searchable database of Software Technologies.) 
SPIE Digital Library 

(journals and proceedings on optics and photonics) 
STN on the Web (training and password required) 

(The other link is via the Patent Examiner's Toolkit On your computer, click on the START button, 

then on the PE Toolkit, then on STN Express.) 
True Query 

(A resurrected version of the old "Computer Select" database, providing full text access to over 
100 technology focused publications, a glossary of technical terms, product reviews and over 
60,000 product specifications from 1999 to the present. If html code appears on your screen, 
click browser's "Reload" or "Refresh" button.) 

Books and Journals 

O Search STIC Online Catalog 
InfoSECURITYnetBASE 
(Information security) 

Knovel 

(Applied science and engineering) 
NetLibrary.com 

(Multidisciplinary subject coverage) 
Safari Online Books 

(Computer and information technology) 
ScienceDirect 

(scientific, technical, and medical journals) 
S prin g er Publishin g Com pany 

(biotech, physics, and computer journals) 

Daily Newspapers 

Fulltext newspaper articles are available electronically in Proquest Direct . 

CD-ROM Resources 

Older full text NPL resources/articles received in CD-Rom format These resources are 
available on EIC2100 PCs in CPK2, 4B40. 

Equipment 

Reference Tools 

Bartleby.com 

(Several versions ofRoget's Thesaurus, a dictionary, an encyclopedia, quotations, English usage 

books and more.) 
Computer References 

(Dictionaries, Acronyms Finders, Encyclopedias) 
Efunda 

(30,000 pages of engineering fundamentals and calculators) 
Ency clo pedia Britannica 
Encyclopedia of Software Engineering 
Eric Weisstein's World of Mathematics 

(A comprehensive online encyclopedia of mathematics.) 
HowStuffWorks 

(Search a term to find articles that explain how it works.) 
Over 2000 Glossary Links 

(Links to numerous technical, specialty, and general glossaries.) 
PCWebopedia 

Wiley Encyclopedia of Electrical and Electronics Engineering 
Yourdictionary.com 
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(Numerous "specialty dictionaries".,, technological, law, business related and more.) 

Services 

EIC2100 Staff 
Foreign Patent Services 
PLUS 

Re quest a Book/Journal Purchase 

Request a Book or Article 

Request a Foreign Patent Publication 

fe-submit ] [Printable form] 
Request a Prior Art Search 

[e-submit] [Printable form] 

Fast & Focused Search Criteria 
STIC Online Catalo g 
Translation Services 



Web Resources 

A Brief History of the Hard Disk Drive 

■*> Ci teSeer (Researchlndex ) 

(Full text scientific research papers - in pdf and postscript formats.) 
Internet Engineering Task Force 

(The IETF Secretariat, run by The Corporation for National Research Initiatives with funding from 

the US government, maintains an index of Internet-Drafts.) 
Nanotechnology 

Reguests for Comments (RFCs) Database 

(Requests for Comments (RFC) document series is a set of technical and organizational 
notes about the Internet (originally the ARPANET), beginning in 1969 and discussing many 
aspects of computer networking, including protocols, procedures and concepts as well as 
meeting notes and opinions.) 

O Usenet Archive (Google Groups) 

tt> Wavback Machine 

(Archived web pages.) 

Submit comments and suggestions to Anne Hendrickson To report technical problems, click here 
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